Search Results for "gpu optimization"
NVIDIA's GPU Innovations Revolutionize Drug Discovery Simulations
NVIDIA's latest GPU optimization techniques, including CUDA Graphs and C++ coroutines, promise to accelerate pharmaceutical research by enhancing molecular dynamics simulations.
NVIDIA Unveils Advanced Optimization Techniques for LLM Training on Grace Hopper
NVIDIA introduces advanced strategies for optimizing large language model (LLM) training on the Grace Hopper Superchip, enhancing GPU memory management and computational efficiency.
Exploring Handwritten PTX Code for GPU Optimization in CUDA
Delve into the potential of handwritten PTX code for enhancing GPU performance in CUDA applications, as outlined by NVIDIA experts.
Together AI Sets New Benchmark with Fastest Inference for Open-Source Models
Together AI achieves unprecedented speed in open-source model inference, leveraging GPU optimization and quantization techniques to outperform competitors on NVIDIA Blackwell architecture.
AI Inference Costs Drop 40% With New GPU Optimization Tactics
Together AI reveals production-tested techniques cutting inference latency by 50-100ms while reducing per-token costs up to 5x through quantization and smart decoding.
NVIDIA TensorRT for RTX Brings Self-Optimizing AI to Consumer GPUs
NVIDIA's TensorRT for RTX introduces adaptive inference that automatically optimizes AI workloads at runtime, delivering 1.32x performance gains on RTX 5090.
NVIDIA Hybrid-EP Slashes MoE AI Training Communication Overhead by 14%
NVIDIA's new Hybrid-EP communication library achieves up to 14% faster training for DeepSeek-V3 and other MoE models on Grace Blackwell hardware.
NVIDIA Blackwell Delivers 4x Inference Boost for India's Sarvam AI Models
NVIDIA's hardware-software co-design achieves 4x inference speedup for Sarvam AI's 30B parameter sovereign models, showcasing Blackwell's NVFP4 capabilities.
NVIDIA MIG Tech Delivers 2.25x Speedups for Power-Constrained AI Workloads
NVIDIA's Multi-Instance GPU technology shows up to 2.25x performance gains for data center workloads under power limits, with implications for AI infrastructure costs.
NVIDIA Run:ai Delivers 2x GPU Utilization Gains for AI Inference Workloads
NVIDIA benchmarks show Run:ai platform doubles GPU utilization while cutting latency 61x for enterprise AI deployments running NIM inference microservices.
NVIDIA Releases Flash Attention Optimization Guide for Blackwell GPUs
NVIDIA's new cuTile framework delivers 1.6x speedups for Flash Attention on B200 GPUs, enabling faster LLM inference critical for AI infrastructure.
FlashAttention-4 Hits 71% GPU Utilization on NVIDIA Blackwell B200
Together AI's FlashAttention-4 achieves 1,605 TFLOPs/s on B200 GPUs, up to 2.7x faster than Triton. New pipelining overcomes asymmetric hardware scaling bottlenecks.